PF04H111 



COLOR SPACE CONVERTING APPARATUS 
AND METHOD OF COLOR SPACE CONVERSION 

FIELD OF THE INVENTION 
[0001] The present invention relates to an image processing technique for 
converting color values based on one color space to color values based on 
another color space. 

BACKGROUND OF THE INVENTION 
[0002] When converting a device-dependent color space that is dependent on 
the color reproduction characteristics of a device, for example, when converting a 
color value in a first device-dependent color space to a color value in a second 
device-dependent color space, color matching of color value is performed through 
the agency of a device-independent color space that is independent of any device, 
so as to match color reproduction in the color space prior to conversion and the 
color space subsequent to conversion. 

[0003] During conversion of the color space of a color value, typically, an 
operation using a matrix is performed, for example, using a first matrix when 
converting the color space of the color value from a first color space to a device- 
independent color space, and using a second matrix when converting the color 
space of the color value from a second color space to a device-independent color 
space. When converting the color space of a color value from a first color space 
to a second color space, in order to accelerate the conversion process, a third 
matrix calculated in advance on the basis of the first matrix and the second matrix 
is used to perform conversion processing of the color space of the color value. 
[0004] However, where the effective number of decimal places of the third matrix 
calculated from the first matrix and the second matrix has not been rounded, so 
that a large effective number of decimal places is retained, there is the problem 
that a long time is required for color space conversion processing. 
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[0005] On the other hand, if, in order to accelerate the conversion process, the 
effective number of decimal places of the third matrix has been rounded, even if 
the white points of the first and second color spaces should match in the device- 
independent color space, the color value based on the second color space 
obtained by converting the color value of the white point based on the first color 
space using the third matrix will not match the color value of the white point based 
on the second color space, that is, there is the problem of inferior color space 
conversion accuracy. Typically, human visual perception is sensitive in the 
colorless region that contains the white point, so even slight deviation in color 
value will be apparent to the eye, so that it becomes impossible to achieve correct 
color reproduction. 

[0006] Also, where white point data in the first color space and white point data 
in the second color space originally do not match in the device-independent color 
space, there is the problem that even if conversion process accuracy using the 
third matrix is raised, the white point in the first color space and the white point in 
the second color space will not match, so a color space conversion process 
satisfactory to the user cannot be performed. 

SUMMARY OF THE INVENTION 
[0007] The present invention was made in order to solve the above-mentioned 
problems, and has as an object to improve color space conversion accuracy in 
cases where the white point in the color space of a conversion source matches the 
white point in the color space of a conversion destination, as well as performing 
color space conversion processing of color values at high speed. It is a further 
object to perform color space conversion processing of a color value while 
eliminating the effects of white point mismatch in cases where the white point in 
the color space of a conversion source does not match the white point in the color 
space of a conversion destination. 

[0008] To solve the problem a first aspect of the present invention provides a 
color space converting apparatus for converting a color value of a first color space 
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to a color value of a second color space. The color space converting apparatus 
pertaining to the first aspect of the present invention comprises a first color space 
converting mechanism for reflecting deviation of converted a color value derived 
by converting the color value of the white point of the first color space to the 
second color space, and the color value of the white point of the second color 
space, and converting the color value of the first color space to the color value of 
the second color space. 

[0009] In the color space converting apparatus pertaining to the first aspect of 
the present invention, the first color space converting mechanism may comprise a 
plurality of color conversion tables, prepared for each combination of the first color 
space and second color space, having characteristics for matching a converted 
color value, derived by converting to the second color space the color value of the 
white point of the first color space, with the color value of the white point of the 
second color space, selecting means for selecting, on the basis of a combination 
of the first color space and the second color space, one color conversion table 
from among the plurality of color conversion tables, and second color space 
converting means for converting a color value of the first color space to a color 
value of the second color space using the selected color conversion table. 
[0010] In the color space converting apparatus pertaining to the first aspect of 
the present invention, the first color space converting mechanism may comprise a 
plurality of color conversion matrices, prepared for each combination of the first 
color space and second color space, having characteristics for matching a 
converted color value, derived by converting to the second color space the color 
value of the white point of the first color space, with the color value of the white 
point of the second color space, selecting means for selecting, on the basis of a 
combination of the first color space and the second color space, one color 
conversion matrix from among the plurality of color conversion matrices, and third 
color space converting means for executing a matrix operation to convert a color 
value of the first color space to a color value of the second color space using the 
selected color conversion matrix. 
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[001 1] The first aspect of the present invention also provides a method of color 
space conversion for converting a color value of a first color space to a color value 
of a second color space. The method of color space conversion pertaining to the 
first aspect of the present invention is characterized in that a color value of the first 
color space is modified to a color value of the second color space, in such a way 
as to eliminate deviation of a converted color value, derived by converting the 
color value of the white point of the first color space to the second color space, 
with respect to the color value of the white point of the second color space. 
[0012] The first aspect of the present invention also provides a color space 
converting program for converting a color value of a first color space to a color 
value of a second color space. The color space converting program pertaining to 
the first aspect of the present invention is characterized in that a first color 
conversion function for modifying a color value of the first color space to a color 
value of the second color space, in such a way as to eliminate deviation of a 
converted color value, derived by converting the color value of the white point of 
the first color space to the second color space, with respect to the color value of 
the white point of the second color space, is realized by means of a computer. 
[001 3] According to the first aspect of the present invention, color space is 
converted using a single matrix operation or color conversion table, so fast color 
conversion processing can be executed. Further, deviation (error) occurring with 
color space conversion can be eliminated, so that the accuracy of color space 
conversion can be improved. 

[0014] In the color space converting apparatus pertaining to the first aspect of 
the present invention, the first color space and second color space may be device- 
dependent color spaces dependent on a device, and a first color value of a device- 
independent color space, derived by converting the color value of the white point 
of the first color space, may be equal to a second color value of the device- 
independent color space, derived by converting the color value of the white point 
of the second color space. Where this arrangement is provided, the first aspect of 
the present invention can better improve the accuracy of color space conversion. 



PF04H111 



[0015] A second aspect of the present invention provides a color space 
converting apparatus for converting a color value of a first color space to a color 
value of a second color space. The color space converting apparatus pertaining to 
the second aspect of the present invention comprises color space converting 
means for performing a matrix operation to convert a color value of the first color 
space to a color value of the second color space, deviation calculating means for 
calculating deviation of the color value of the achromatic color of the second color 
space with respect to a converted color value of the second color space, derived 
by executing the matrix operation on the color value of the achromatic color of the 
first color space, and conversion accuracy improving means for reflecting the 
calculated deviation to improve color space conversion accuracy. 
[0016] According to the second aspect of the present invention, color space is 
converted using a single matrix operation or color conversion table, so fast color 
conversion processing can be executed. Further, deviation (error) occurring with 
color space conversion can be eliminated, so the accuracy of color space 
conversion can be improved. 

[0017] In the color space converting apparatus pertaining to the second aspect 
of the present invention, the first color space and second color space may be 
device-dependent color spaces dependent on a device, and a first color value of a 
device-independent color space, derived by converting the color value of the 
achromatic color of the first color space, may be equal to a second color value of 
the device-independent color space, derived by converting the color value of the 
achromatic color of the second color space. Where this arrangement is provided, 
the accuracy of color space conversion can be better improved. 
[0018] A third aspect of the present invention provides a color space converting 
apparatus for matching the color value of the white point of a first color space with 
the color value of the white point of a second color space in a device-independent 
color space that is independent of any device, and converting a color value of the 
first color space to a color value of the second color space. The color space 
converting apparatus pertaining to the third aspect of the present invention 
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comprises a plurality of color conversion tables, prepared for each combination of 
the first color space and second color space, having characteristics for matching 
the color value of the white point of the second color space with a converted color 
value, derived by converting the color value of the white point of the first color 
5 space to the second color space using a third matrix generated on the basis of a 
first matrix for converting a color value of the first color space to a color value of 
the device-independent color space, and a second matrix for converting a color 
value of the second color space to a color value of the device-independent color 
space; selecting means for selecting, on the basis of a combination of the first 
10 color space and the second color space, one color conversion table from among 
the plurality of color conversion tables; and color space converting means for 

Mi 

q converting a color value of the first color space to a color value of the second color 
-g space using the selected color conversion table. 

j§ [001 9] According to the third aspect of the present invention, the color value of 
SB 15 the white point of a first color space and the color value of the white point of a 
second color space can be matched in a device-independent color space, and 
error occurring with color space conversion can be eliminated, so that the color 

Ifl ue tne wnite point of tne color s P ace P r 'or to conversion can be matched with 

the color value of the white point of the color space after conversion, and the 

20 accuracy of color space conversion can be improved. Further, since color space 
is converted by executing a single matrix operation, fast color conversion 
processing can be executed. Color values in a first color space can be modified to 
color values in a second color space using a color conversion table instead of 
executing a matrix operation. 

25 [0020] The color space converting apparatus pertaining to the third aspect of the 
present invention may comprise color space converting means for converting a 
color value of the first color space to a color value of the second color space using 
a third matrix created on the basis of a first matrix for converting a color value of 
the first color space to a color value of the device-independent color space and a 

30 second matrix for converting a color value of the second color space to a color 
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value of the device-independent color space; deviation calculating means for 
calculating deviation of the color value of the achromatic color of the second color 
space with respect to a converted color value converted from the color value of the 
achromatic color of the first color space to a color value of the second color space 
by means of the converting means; and conversion accuracy improving means for 
reflecting the calculated deviation to improve color space conversion accuracy by 
the converting means. 

[0021] According to the third aspect of the present invention, the color value of 
the white point of a first color space and the color value of the white point of a 
second color space can be matched in a device-independent color space, and 
deviation (error) occurring with color space conversion can be eliminated, so the 
color value of the achromatic color of the color space prior to conversion and the 
color value of the achromatic color of the color space after conversion can be 
matched, and the accuracy of color space conversion can be improved. Further, 
since color space is converted by executing a single matrix operation, fast color 
conversion processing can be executed. Color values in a first color space can be 
modified to color values in a second color space using a color conversion table 
instead of executing a matrix operation. 

[0022] The color space converting apparatus pertaining to the third aspect of the 
present invention may further comprise file reading means for reading the color 
value and output control information from a file that includes within a single file the 
color value and the output control information, which stipulates output conditions 
for color values, with the first color space being determined on the basis of the 
read output control information. Where this arrangement is provided, the color 
space of a color value can be acquired automatically. Also, the deviation 
calculating means can correct the color value of the converted white point to 
eliminate the deviation; or the deviation can be reflected, and the third matrix 
corrected in order to eliminate the deviation. In either case, deviation occurring 
with color space conversion can be eliminated. 
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[0023] The third aspect of the present invention provides a color space 
converting program for matching the color value of the white point of a first color 
space with the color value of the white point of a second color space in a device- 
independent color space, and converting a color value of the first color space to a 
color value of the second color space. The color space converting program 
pertaining to the third aspect of the present invention is characterized in that a 
function for calculating deviation of the color value of the white point of the second 
color space with respect to a color value that has been converted from the color 
value of the white point of the first color space to the second color space using a 
third matrix created on the basis of a first matrix for converting a color value of the 
first color space to a color value of the device-independent color space and a 
second matrix for converting a color value of the second color space to a color 
value of the device-independent color space; and a function for improving 
conversion accuracy improving on the basis of the calculated deviation, are 
realized by means of a computer. 

[0024] The third aspect of the present invention may also be provided as a 
method of color space conversion. Where provided as a color space converting 
program or method of color space conversion, it is possible to obtain working 
effects similar to those obtainable where provided as a color space converting 
apparatus. Like the color space converting apparatus pertaining to the third 
aspect of the present invention, color values in a first color space can be modified 
to color values in a second color space using a color conversion table instead of 
executing a matrix operation. 

[0025] A fourth aspect of the present invention provides a color space converting 
apparatus for converting a color value of a first color space to a color value of a 
second color space. The color space converting apparatus pertaining to the fourth 
aspect of the present invention comprises first converting means for converting a 
color value of the first color space to a color value of a device-independent color 
space using a first matrix; second converting means for converting a color value of 
the second color space to a color value of the device-independent color space 
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using a second matrix; determining means for determining whether the color value 
of a first white point in the device-independent color space converted from the 
color value of the white point of the first color space by the first converting means 
matches the color value of a second white point in the device-independent color 
space converted from the color value of the white point of the second color space 
by the second converting means; third converting means for converting a color 
value of the first color space to a color value of the second color space using a 
third matrix created on the basis of the first matrix and the second matrix; deviation 
calculating means that, in the event it is determined that the color value of the first 
white point and the color value of the second white point match, calculates 
deviation of the color value of the achromatic color of the second color space and 
a converted color value that has been converted by the third converting means 
from the color value of the achromatic color in the first color space to a color value 
in the second color space; and conversion accuracy improving means for 
improving color space conversion accuracy by the third converting means on the 
basis of the calculated deviation. 

[0026] According to the fourth aspect of the present invention, it can be 
determined whether the color value of the white point of a first color space and the 
color value of the white point of a second color space match in a device- 
independent color space, and in the event that they match, deviation (error) 
occurring with color space conversion can be eliminated, so a decline in color 
space conversion accuracy due to achromatic color (white point) mismatch can be 
prevented. Further, since color space is converted by executing a single matrix 
operation, fast color conversion processing can be executed. 
[0027] The color space converting apparatus pertaining to the fourth aspect of 
the present invention may further comprise first correcting means that, in the event 
it is determined that the color value of the first white point and the color value of 
the second white point do not match, corrects the second matrix so that the color 
value of the second white point matches the color value of the first white point; or 
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second correcting means that corrects the first matrix so that the color value of the 
first white point matches the color value of the second white point. 
[0028] According to the fourth aspect of the present invention, it can be 
determined whether the color value of the white point of a first color space and the 
color value of the white point of a second color space match in a device- 
independent color space, and in the event that they do not match, the white points 
are matched, thus improving color space conversion accuracy even where white 
points do not match. Further, since color space is converted by executing a single 
matrix operation, fast color conversion processing can be executed. 
[0029] The fourth aspect of the present invention provides a method of color 
space conversion for converting a color value of a first color space to a color value 
of a second color space. The method of color space conversion pertaining to the 
fourth aspect of the present invention is characterized by determining whether the 
color value of a first white point converted, using a first matrix, from the color value 
of the white point of the first color space to the color value of the white point of the 
device-independent color space, matches the color value of a second white point 
converted, using a second matrix, from the color value of the white point of the 
second color space to the color value of the white point of the device-independent 
color space; in the event that the first white point and the second white point match, 
calculating deviation of the color value of the achromatic color of the second color 
space that has been converted to the second color space from the color value of 
the achromatic color in the first color space using a third matrix created on the 
basis of the first matrix and the second matrix; and correcting the coefficient of the 
third matrix so as to eliminate the calculated deviation. 

[0030] The fourth aspect of the present invention further provides a color space 
converting program for matching a color value of a first color space with a color 
value of a second color space. The color space converting program pertaining to 
the fourth aspect of the present invention is characterized in that a function for 
determining whether the color value of a first white point converted, using a first 
matrix, from the color value of the white point of the first color space to the color 
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value of the white point of a device-independent color space, matches the color 
value of a second white point converted, using a second matrix, from the color 
value of the white point of the second color space to the color value of the white 
point of the device-independent color space; a function for, in the event that the 
first white point and the second white point match, calculating deviation of the 
color value of the achromatic color of the second color space from a converted 
color value that has been converted to the second color space from the color value 
of the achromatic color in the first color space using a third matrix created on the 
basis of the first matrix and the second matrix; and a function of reflecting the 
calculated deviation to improve the accuracy of the color space conversion, are 
realized by means of a computer. 

[0031] A fifth aspect of the present invention provides a color space converting 
apparatus for matching the white point in a first RGB color space with the white 
point of a second RGB color space in an XYZ color space, and converting a color 
value (R1 , G1 , B1 ) of the first RGB color space to a color value (R2, G2, B2) of the 
second RGB color space. The color space converting apparatus pertaining to the 
fifth aspect of the present invention may comprise converting means for converting 
a color value (R1 , G1 , B1 ) of the first RGB color space to a color value (R2, G2, 
B2) of the second RGB color space by means of the following Equation 1, using a 
matrix L = N" 1 M calculated in advance on the basis of a matrix M used when 
converting a color value in a first RGB color space to a color value of an XYZ color 
space, and a matrix N used when converting a color value in a second RGB color 
space to a color value of an XYZ color space; 
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[0032] deviation calculating means for calculating deviation of a color value (1,1, 
1) representing the white point of the second color space with respect to a 
converted white point color value (a3 + b3 + c3, d3 + e3 + f3, g3 + h3 + i3), 
converted by the converting means from a color value (1,1,1) representing the 
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white point of the first color space, to a color value representing the white point of 
the second color space, and conversion accuracy improving means for reflecting 
the calculated deviation to improve color space conversion accuracy by the 
converting means. 

[0033] The fifth aspect of the present invention may also be provided as a 
method of color space conversion or a color space converting program. In either 
case it is possible to obtain working effects similar to those of the third aspect of 
the present invention, and like third aspect of the present invention, it can be 
realized through various aspects. 

[0034] A sixth aspect of the present invention provides a color space converting 
apparatus for converting a color value (R1 , G1 , B1) in a first RGB color space to a 
color value (R2, G2, B2) in a second RGB color space. The color space 
converting apparatus according to the sixth aspect of the present invention 
comprises first converting means for converting a color value (R1 , G1, B1) of the 
first RGB color space to a color value (X, Y, Z) of an XYZ color space by means of 
the following Equation 1, using a matrix M, 
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[0035] second converting means for converting a color value (R2, G2, B2) of the 
second RGB color space to a color value (X, Y, Z) of an XYZ color space by 
means of the following Equation 2, using a matrix N, 
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[0036] third converting means for converting a color value (R1 , G1 , B1) in the 
first RGB color space to a color value (R2, G2, B2) in the second RGB color space 
by means of the following Equation 3, using a matrix L =N" 1 M calculated in 
advance on the basis of a matrix M and matrix N, 
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[0037] determining means for determining whether the three relationships a1 + 
b1 + d = a2 + b2 + c2, d1 + e1 + fl = d2 + e2 + f2, and g1 + hi + M = g2 + h2 + i2 
are true for a color value of the XYZ color space derived by converting a color 
5 value (1,1,1) representing the white point of the first RGB color space by means 
of the first converting means, and a color value of the XYZ color space derived by 
converting a color value (1,1,1) representing the white point of the second RGB 
color space by means of the second converting means, deviation calculating 
means that, in the event it is determined that the three relationships are true, 
10 calculates deviation of a color value (1,1,1) representing the white point of the 
second RGB color space with respect to a converted color value (a3 + b3 + c3, d3 
+ e3 + f3, g3 + h3 + i3), converted by the third converting means from a color 
value (1 , 1 , 1 ) representing the white point of the first RGB color space to a color 
value of the second RGB color space, and first correcting means for correcting the 

SK3 

1 5 coefficients of the matrix L so as to eliminate the calculated deviation. 

[0038] The color space converting apparatus according to the sixth aspect of the 
present invention may further comprise second correcting means that, in the event 
that it is determined that at least one relationship of the three relationships is not 
true, corrects the matrix N, or third correcting means that corrects the matrix M. 
20 [0039] The sixth aspect of the present invention may also be provided as a 

method of color space conversion or a color space converting program. In either 
case sixth aspect of the present invention can give working effects similar to those 
of the forty-third aspect of the present invention, and like fourth aspect of the 
present invention, it can be realized through various aspects, 
25 [0040] A seventh aspect of the present invention provides a method for 

manufacture of a color space conversion matrix for converting a color value of a 
first color space to a color value of a second color space. The method for 
manufacture of a color space conversion matrix according to the sixth aspect of 
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the present invention is characterized in that a matrix operation using a matrix is 
executed to convert the color value of the white point of the first color space to the 
color value of the white point of the second color space; deviation between the 
color value of the second color space obtained by executing the matrix operation 
5 and the color value of the achromatic color of the second color space is calculated; 
the matrix is corrected to reflect the calculated deviation so as to match the 
converted color value of the second color space with the color value of the 
achromatic color of the second color space, to calculate a corrected matrix; and 
the calculated matrix is stored in storage means. 
10 [0041] The achromatic color of the second color space may be white (white 
point). According to the method for manufacture of a color space conversion 
p matrix pertaining to the seventh aspect of the present invention, when converting a 
2 color value of a first color space to a color value of a second color space, color 
j;| values for achromatic color (white point) may be made to match. Also, the 
jfi 15 accuracy accompanying color space conversion can be improved. 

« [0042] An eighth aspect of the present invention provides a method for 

O 

fP manufacture of a color space conversion table for converting a color value of a first 

Mi 

v g color space to a color value of a second color space. The eighth aspect of the 
irj present invention is characterized in that a matrix operation is executed to convert 
20 the color value of the white point of the first color space to the color value of the 
white point of the second color space; deviation between the color value of the 
second color space obtained by executing the matrix operation and the color value 
of the achromatic color of the second color space is calculated; the matrix is 
corrected to reflect the calculated deviation so as to match the converted color 
25 value in the second color space with the color value of the achromatic color of the 
second color space; a matrix operation using the calculated matrix is executed to 
convert a plurality of color values of the first color space to a plurality of color 
values of the second color space; a color space conversion table associating the 
plurality of color values of the first color space with the plurality of color values of 
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the second color space is created; and the created color space conversion table is 
stored in storage means. 

[0043] The achromatic color of the second color space may be white (white 
point). According to the method for manufacture of a color space conversion table 
pertaining to the eighth aspect of the present invention, when converting a color 
value of a first color space to a color value of a second color space, color values 
for achromatic color (white point) may be made to match. Also, the accuracy 
accompanying color space conversion can be improved. 

BRIEF DESCRIPTION OF THE DRAWINGS 
[0044] Fig. 1 is an illustrative diagram showing an example of an image data 
output system in which the image output apparatus device in accordance with a 
first embodiment may be implemented. 

Fig. 2 is a block diagram showing a simplified arrangement of a digital still 
camera capable of generating an image file (image data) for output by the image 
output apparatus in accordance with the first embodiment. 

Fig. 3 is an illustrative diagram showing conceptually an internal structure 
for an image file 100 stored in Exif file format. 

Fig. 4 is a block diagram showing the general arrangement of a color printer 
20 in accordance with the first embodiment. 

Fig. 5 is an illustrative diagram showing the internal arrangement of a 
control circuit 30 of color printer 20. 

Fig. 6 is a flow chart showing a processing routine for print processing in a 
color printer 20 in accordance with the first embodiment. 

Fig. 7 is a flow chart showing the flow of image processing in a color printer 
20 in accordance with the first embodiment. 

Fig. 8 is an illustrative diagram showing the color space areas of visible 
area (V), sRGB (SR), NTSC (NS) and wRGB (WR) on an RGB color space. 

Fig. 9 is a flow chart showing a processing routine for print processing in a 
color printer 20 in accordance with a second embodiment. 
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DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

[0045] The color space converting apparatus pertaining to the present invention, 
embodied as an image output apparatus, is described hereinbelow based on some 
examples in the order hereinbelow while referring to the drawings. 

A. Arrangement of color value output system including image output apparatus in 
accordance with the first embodiment 

B. Arrangement of image output apparatus 

C. Image processing, including color space conversion processing, in image 
output apparatus 

D. The second embodiment 

[0046] A. Arrangement of image data output system including image output 
apparatus in accordance with the first embodiment 

The arrangement of an image data output system permitting 
implementation of the image processing apparatus device pertaining Example 1 is 
described with reference to Figs. 1 and 2. Fig. 1 is an illustrative diagram showing 
an example of an image data output system in which the image output apparatus 
device in accordance with the first embodiment may be implemented. Fig. 2 is a 
block diagram showing a simplified arrangement of a digital still camera capable of 
generating an image file (image data) for output by the image output apparatus in 
accordance with the first embodiment. 

[0047] Image output system 10 comprises a digital still camera 12 as an input 
device for generating an image file; and a color printer 20 as an output device for 
performing image processing on the basis of an image file generated by digital still 
camera 12, and outputting an image. As the output apparatus there could be used, 
besides a printer 20, a CRT display, LCD display, or other such monitor 14, a 
projector, or the like. In the description hereinbelow it shall be assumed that a 
color printer 20 is used as the output apparatus. 
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[0048] Digital still camera 12 is a camera that acquires an image by means of 
imaging light information with a digital device (e.g. a CCD or photomultiplier); as 
shown in Fig. 2 it comprises an optical circuit 121 for gathering light information, 
an image acquisition circuit 122 for controlling the digital device to acquire an 
image, an image processing circuit 123 for processing the acquired digital image; 
and a control circuit 124 for controlling the various circuits. Digital still camera 12 
stores the acquired image as digital data in a memory card MC as the storage 
apparatus. As the storage format for image data in digital still camera 12, the 
JPEG format is typical, but other storage formats could be used, such as TIFF 
format, GIF format, BMP format, RAW format or the like. Digital still camera 12 
also comprises a Select/Set button 126 for setting various functions. 
[0049] Typically, where image data is stored in JPEG format, digital still camera 
12 first generated image data (color values) in the sRGB color space, and 
executes a matrix S inverse operation, described later, to convert the color space 
of the color values from the sRGB color space to a YCbCr color space. This is 
because the YCbCr color space has color space characteristics suited to data 
compression. 

[0050] The digital still camera 12 used in this image data output system 10 
stores image data plus appended information as an image file on memory card 
MC. The image file generated by digital still camera 12 typically has a file 
structure according to the digital still camera image file format standard (Exit), in 
order to preserve image file compatibility. The Exif file specifications are laid down 
by the Japan Electronics and Information Technologies Industries Association 
(JEITA). 

[0051] The simplified structure in an image file where it has a file format in 
accordance with the Exif file format is described with reference to Fig. 3. Fig. 3 is 
an illustrative diagram showing conceptually an internal structure for an image file 
100 stored in Exif file format. The terms file structure, data structure and storage 
area in this example mean a file or data image in a state wherein a file or data etc. 
is stored in a storage apparatus. 
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[0052] As an Exif file, image file 1 00 contains a JPEG image data storage area 

101 for storing image data in JPEG format, and an extra information storage area 

102 for storing extra information of various kinds relating to the stored JPEG 
image data. The extra information storage area 112 contains, in TIFF format, 
photographic information relating to JPEG image photographic conditions such as 
color space at the time of shooting, shooting date, exposure, shutter speed, etc., 
and thumbnail image data for JPEG images stored in JPEG image data storage 
area 101. When image data is written to the memory card MC, this extra 
information is automatically stored in the extra information storage area 102. The 
extra information storage area 102 is also provided with a Makernote data storage 
area 103, an undefined area currently left available by DSC manufacturers; the 
Makernote data storage area 103 can be used by a DSC manufacturer to store 
any desired information. It is common knowledge to practitioners of the art that 
files of the Exif format use tags to designate data of various kinds. 

[0053] The Makernote data storage area 103 is also provided with an 
arrangement whereby stored data can be identified by means of tags; in this 
example, there is stored device control information (image processing control 
information) for controlling image processing in color printer 20. 
[0054] The control information is information for designating image output 
conditions so as to achieve optimal image output results, considering the image 
output characteristics of an output apparatus such as color printer 20 or the like. 
Information stored as control information includes information designating image 
output conditions in an output apparatus, and information designating conditions 
for applying characteristics to output in an output apparatus. Information 
designating output conditions includes parameters relating to, for example, gamma 
value and target color space. Information relating to color space is included also 
as a ColorSpace tag in the extra information, but color space information included 
in the extra information is color space information at the time of creation of the 
image data (color values), while color space information included in the control 
information is information for color space during of arbitrarily designatable 



18 



PF04H111 



(settable) image processing. Information applying characteristics to output 
includes parameters relating, for example, to contrast, color balance adjustment, 
sharpness, and color correction. Color space conversion processing in this 
example can be executed using either color space information at the time of image 
5 creation or color space information for use during image processing, but in the 
following description, it is assumed that color space information at the time of 
image creation is used. 

[0055] An image file generated by digital still camera 12 is sent to color printer 
20, for example, via a cable CV and a computer PC, or via cable CV. Or, the 
10 image file is sent to color printer 20 via a computer PC connected to the memory 
card MC installed in the digital still camera 12, or the memory card MC directly to 
printer 20. In the description hereinbelow, the description is based on the case of 

O the memory card MC being connected directly to color printer 20. 

tQ 
02 
OQ 

m 15 [0056] B. Arrangement of image output apparatus 

B The general arrangement of the image output apparatus pertaining to 

2 Example 1 , namely, a color printer 20, is described with reference to Fig. 4. Fig. 4 

is a block diagram showing the general arrangement of a color printer 20 in 
O accordance with the first embodiment. 

20 [0057] Color printer 20 is a printer capable of color image output and is a printer 
of ink-jet type that forms an image by ejecting inks of, for example, the four colors 
of cyan (C), magenta (M), yellow (Y) and black (K), onto a print medium to 
produce a dot pattern, or it is a printer of electrophotographic type that 
transfer/fixes color toner onto a print medium to produce an image. For the 
25 colored inks, besides the aforementioned four colors, light cyan (LC), light 
magenta (LM), or dark yellow (DY) colored inks may also be used. 
[0058] As shown in the drawing, color printer 20 comprises a mechanism for 
driving a print head 21 1 conveyed on a carriage 21 to perform ink ejection and dot 
formation, a mechanism for causing reciprocating motion of this carriage 21 in the 
30 axial direction of a platen 23 by means of a carriage motor 22, a mechanism for 
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advancing the printer paper P by means of a paper feed motor 24, and a control 
circuit 30. The mechanism for causing reciprocal motion of carriage 21 in the axial 
direction of platen 23 comprises a slide rail 25 extending parallel to the axis of 
platen 23 for slidably retaining cartridge 21, a pulley 27 having an endless drive 
5 belt 26 extending between it and carriage motor 22, a position sensor 28 for 
sensing the home position of carriage 21 , and the like. The mechanism for 
advancing printer paper P comprises a platen 23, a paper feed motor 24 for 
causing platen 23 to rotate, an auxiliary paper feed roller (not shown), and a gear 
train (not shown) for transmitting rotation of paper feed motor 24 to platen 23 and 
10 the auxiliary paper feed roller. 

[0059] Control circuit 30, while exchanging signals with the control panel 29 of 
the printer, appropriately controls operation of paper feed motor 24, carriage motor 
Q 22, and print head 21 1 . Printer paper P supplied to color printer 20 is set so as to 
be pinched between platen 23 and the auxiliary paper feed roller, and is advanced 

jg 15 by predetermined increments depending on the angle of rotation of platen 23. 

N 

[0060] An ink cartridge 212 and ink cartridge 213 are installed on carriage 21 . 
:| Ink cartridge 212 contains black (K) ink, while ink cartridge 213 contains other inks, 

ill 

f* specifically, inks of the three colors of cyan (C), magenta (M), yellow (Y), plus light 
13 cyan (LC), light magenta (LM), and dark yellow (DY), for a total of six colored inks. 

Hi 

20 [0061] The internal arrangement of control circuit 30 of color printer 20 is 

described with reference to Fig. 5. Fig. 5 is an illustrative diagram showing the 
internal arrangement of a control circuit 30 of color printer 20. As shown in the 
drawing, control circuit 30 comprises a CPU 31 ; PROM 32; RAM 33; a PCMCIA 
slot 34 for acquiring data from a memory card MC; a peripheral I/O portion (PIO) 

25 35 for performing exchange of data with paper feed motor 24, carriage motor 22 
etc., a timer 36, a drive buffer 37 and the like. Drive buffer 37 is used as a buffer 
for supplying dot ON/OFF signals to ink ejecting heads 214 -220. These are 
interconnected by means of a bus 38 to enable exchange of data among them. 
Control circuit 30 additionally comprises an oscillator 39 for outputting a drive 

30 waveform of predetermined frequency, and a distributed output instrument 40 for 
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distributing output from oscillator 39 to ink ejecting heads 214 -220 at 
predetermined timing. 

[0062] Control circuit 30 reads out an image file 100 from memory card MC, 
analyzes the extra information, and executes image processing based on the 
5 analyzed control information Al. Control circuit 30 outputs dot data to drive buffer 
37 at predetermined timing while synchronizing with operation of paper feed motor 
24 and carriage motor 22. The detailed flow of image processing executed by 
control circuit 30 is described hereinbelow. 

10 [0063] C. Image processing, including color space conversion processing, in 
image output apparatus 

Image processing in the color printer 20 pertaining to Example 1 is now 
described with reference to Fig. 6 and Fig. 7. Fig. 6 is a flow chart showing a 
*Q processing routine for print processing in a color printer 20 in accordance with the 
HI 15 first embodiment. Fig. 7 is a flow chart showing the flow of image processing in a 

color printer 20 in accordance with the first embodiment. In the following 
J? description the sRGB color space is designated as color space information. 

[0064] When a memory card MC is inserted in slot 34, the control circuit 30 
(CPU 31) of printer 20 reads out the image file 100 from memory card MC, and 
20 temporarily places the read out image file 100 in RAM 33 (STEP 100). CPU 31 
searches for the ColorSpace tag, which indicates the color space at the time of 
image data creation, from the extra information storage area 102 of image file 100 
(Step S1 10). If CPU 31 successfully searches/finds the ColorSpace tag (Step 
S120: Yes), it acquires and analyzes the color space information at the time of 
25 image data creation (Step S130). On the basis of the analyzed color space 

information, CPU 31 executes a process to correct the matrix L used in the color 
space conversion process, described later, to calculate a matrix L' (Step S140). 
The calculation procedure for matrix U is described in detail later. CPU 31 
executes an image process including a color space conversion process using the 
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matrix L' calculated by means of correction (Step S150) and prints out the 
processed image data (Step S160). 

[0065] If CPU 31 has not searched/found a ColorSpace tag (Step S120: No), the 
color space defining the image data (color values) cannot be determined, so it 
5 acquires from ROM 32 color space information held as default values by color 
printer 20, for example, information for the sRGB color space, and executes 
ordinary image processing (STEP S170). CPU 31 prints out the processed image 
data (Step S160) and terminates the processing routine. 

[0066] Next, the calculation procedure for matrix L' used during the color space 
10 conversion process in this example is described. In the description of the color 
space conversion process, the term color value is used instead of image data. 
J 8 * Matrix L' = 

a 

13 (N~ 1 M)' is a matrix for color space conversion, used in a matrix operation equation 
*Q during conversion of a color value of a first color space to a color value of a 

m 

gg 15 second color space. As will be described later, matrix L 1 = (N^M)' is obtained by 

executing a correction process on a matrix U = N M. Typically, when converting a 
9 color space that represents (defines) color values, in order to match color 

H reproduction in the color space of the conversion source with color reproduction in 

■J3 

O the color space of the conversion destination, conversion is performed through the 

ni 

20 agency of a device-independent color space (machine-independent color space) 
that is not dependent on a particular device such as a DSC or printer, for example, 
an XYZ color space. The commonly used RGB color space is a device-dependent 
color space dependent on a device, and is defined for each individual device, so in 
order to correctly reproduce colors in another device, it is necessary to perform 

25 color matching so that the same values are always assumed in the XYZ color 

space or other such device-independent color space. Following is a description of 
a matrix M and a matrix N. 

[0067] In this example, in order to convert a color value of a first color space, for 
example, an RGB color space, into a color value of the XYZ color space, a matrix 
30 operation M is executed using a matrix M. When executing matrix operation M, 
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CPU 31 refers to the ColorSpace tag to reflect the color space at the time the color 
value was created, uses the written in color space information to set the matrix 
values of matrix (M), and executes the matrix operation. A color space such as 
the sRGB color space or NTSC color space may be used at this time. The matrix 
5 operation M using a matrix M is, for example, the operation equation given below. 







(Rs\ 


Y 


= M 


Gs 






K B Sj 







(a\ 


b\ 


c n 




'0.4124 


0.3576 


0.1805"} 


M 




dl 


el 


n 




0.2126 


0.7152 


0.0722 






,*1 


hi 


ij 




v 0.0193 


0.1192 


0.9505 ; 



q [0068] To date, the color space used during image processing in printers and 
2 computers has been fixed to sRGB, and thus even where a digital still camera 12 
•fl is capable of creating color values based on a wider color space, for example, 

in 

99 10 NTSC, it has not been possible to effectively utilize the wider color space. 

N 

According to the present embodiment, however, there is used a printer (printer 

Q 

m driver) that uses the color space information at the time of color value creation, 
%J described in the extra information of the image file, to modify values in the matrix 
jjJ (M) for the matrix operation M used during image processing. Accordingly, even 
15 where digital still camera 12 creates color values in the NTSC color space, one of 
the RGB color spaces having wider space than the sRGB color space, the color 
space in which the color values were created can be utilized effectively to allow 
correct color reproduction to be realized. 

[0069] In this example, in order to convert a color value based on a second color 
20 space, for example the wRGB color space, to a color value based on the XYZ 
color space, that is, in order to associate a color value based on the wRGB color 
space with a color value based on the XYZ color space, a matrix operation N using 
matrix N is executed. As shown in Fig. 8, the wRGB color space is a wider color 
space than the sRGB color space. The matrix operation N using a matrix N is, for 
25 example, the operation equation given below. 
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'0.5767 0.1856 0.1882 N 
0.2973 0.6274 0.0753 
v 0.0270 0.0707 0.9913 ; 

[0070] For the sRGB color space and wRGB color space in this example, color 
values of white points (illumination light source) based on each of the two color 
spaces assume the same value in the XYZ color space. That is, between the 
color value of the white point based on the sRGB color space (Rs, Gs, Bs) = 
(1 .0000, 1 .0000, 1 .0000) and the color value of the white point based on the 
wRGB color space (Rw, Gw, Bw) = (1.0000, 1.0000, 1.0000), the relationships a1 
+ b1 + d = a2 + b2 + c2, d1 + e1 + f1 = d2 + e2 + f2, and g1 + hi + i1 = g2 + h2 + 
i2 are true. Specifically applying the example matrices M, N, the color value of a 
white point based on the sRGB color space (Rs, Gs, Bs) = (1.0000, 1.0000, 
1 .0000) is converted by means of matrix operation M to a color value having the 
value (X, Y, Z) = (0.9505, 1 .0000, 1 .8090), and the color value of a white point 
based on the wRGB color space (Rw, Gw, Bw) = (1.0000, 1.0000, 1.0000) is 
converted by means of matrix operation N to a color value having the values (X, Y, 
Z) = (0.9505, 1 .0000, 1 .8090). Accordingly, the color value of the white point 
based on the sRGB color space and the color value of the white point based on 
the wRGB color space are correctly associated through the agency of the XYZ 
color space. 

[0071] By sequentially executing matrix operation M using matrix M and matrix 
operation N" 1 using matrix NT 1 , a color value of the sRGB color space can be 
converted to a color value of the wRGB color space, but the operation process 
time will be prolonged. Accordingly, a matrix L (N" 1 M) operation using a pre- 
calculated matrix (N" 1 M) is executed when converting a color value of the sRGB 
color space to a color value of the wRGB color space. The matrix operation L 
using matrix L is, for example, the operation equation given below. 
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[0072] When the color value of a white point based on the sRGB color space 
(Rs, Gs, Bs) = (1 .0000, 1 .0000, 1 .0000) is converted by means of matrix operation 
L to a color value based on the wRGB color space, the value (Rw, Gw, Bw) = 
(1 .0001 , 1 .0001 , 1 .0000) is obtained. Therefore, the color value of a white point 
based on the sRGB color space will not convert correctly to the color value of a 
white point based on the wRGB color space. This is because, considering that 
number of effective decimal places in matrix M and matrix N is 4 places below the 
decimal point, in the process of calculating matrix L, the fifth decimal place below 
the decimal point is rounded, so that the effective decimal places are the four 
places below the decimal point. Using a greater number of effective decimal 
places will increase conversion accuracy, but the operation processing speed will 
be slower, so using matrix L becomes meaningless. On the other hand, in the 
sRGB color space, the color value represented as white (achromatic color: Rs = 
Bs = Gs) is not represented as achromatic color in the wRGB color space (Rs = Bs 
* Gs), so gray balance is destroyed. As noted, human visual perception is 
extremely sensitive in the gray region, so any disturbance of gray balance will be 
visible to the eye. 

[0073] In this example, a matrix L' having coefficients (aL', bL', cL", dl_\ eL', fL', 
gL', hl_', iL") derived by correcting the coefficients of matrix L (aL, bL, cL, dL, eL, fL, 
gL, hL, iL) in the following manner is used to convert the color space of a color 
value from sRGB to wRGB, while preserving gray balance. 
E = aL = bL + cL-1.0, 
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D = E/3, 

Here, Dm: value of effective decimal places D and above; Ds = D - Dm: 
value of effective decimal places below D; and De = E - 3 * Dm. Where the 
smallest unit of effective decimal place is S, De can assume the value 0, S, or 2 * 
S. Depending on the value of De, the corrected values of al_, bl_ and cL, i.e., al_', 
bL' and cL', are calculated as follows. 

De = 0 

aU = al_ - Dm, bL' = bL - Dm, cL' = cL - Dm 
De = S 

aU = al_ - Dm, bL 1 = bL - Dm, cL' = cL - Dm - S 
De = 2 * S 

aL' = aL - Dm, bL' = bL - Dm - S, cL' = cL - Dm - S 
[0074] Regarding parameters from which S is subtracted, subtraction is done in 
the order cL, bL, but the reverse order is acceptable as well. Error correction is 
executed in similar fashion for dL, eL, fL, gL, hL and iL. 

[0075] Where the aforementioned correction method is used on matrix L in this 
example, the top row is 

E = 0.7152 + 0.02848 + 0.0001 - 1.0 = 0.0001, 

D = (0.0001)/3 = 0.0000333..., 

where effective decimal places are four places below the decimal point, 
Dm = 0.0000, 

Ds = 0.0000333... - 0.0000 = 0.0000333..., 
De = E - 3 * Dm = 0.0001 - 0.0000 = 0.0001 , and 
S = 0.0001. 
Thus, De = S, 

aL' = aL - Dm = 0.7152 - 0.0000 = 0.7152, 

bL' = bL - Dm = 0.02848 - 0.0000 = 0.02848, and 

cL* = cL - Dm - S = 0.0001 - 0.0000 - 0.0001 = 0.0000. 

The middle row is 

E = 0.0000 + 1.0001 + 0.0000 - 1.0 = 0.0001, 
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D = (0.0001)/3 =0.0000333..., 

where effective decimal places are four places below the decimal point, 
Dm = 0.0000, 

Ds = 0.0000333... - 0.0000 = 0.0000333..., 
De = E - 3 * Dm = 0.0001 - 0.0000 = 0.0001, and 
S = 0.0001. 
Thus, De = S, 

dU = dl_ - Dm = 0.0000 - 0.0000 = 0.0000, 
eU = el_-Dm= 1.0001 -0.0000= 1.0001, and 
fL' = fl_ - Dm -S = 0.0000 - 0.0000 - 0.0001 = -0.0001. 
The bottom row is 

E = 0.0000 + 0.0412 + 0.9588 - 1.0 = 0.0000, 
D = (0.0001 )/3 =0.0000, 

where effective decimal places are four places below the decimal point, 
Dm = 0.0000, 

Ds = 0.0000 - 0.0000 = 0.0000, 

De = E - 3 * Dm = 0.0000 - 0.0000 = 0.0000, and 

S = 0.0001. 

Thus, De = S, 

gU = gL - Dm = 0.0000 - 0.0000 = 0.0000, 

eL' = el_ - Dm = 0.0412 - 0.0000 = 0.0412, and 

fL' = fL - Dm = 0.9588 - 0.0000 = 0.9588. 
[0076] Accordingly, the matrix L' derived by correcting matrix L is represented as 
follows. 



L'= (N- 1 M)' = 



f 0.71 52 0.2848 0.0000 ^ 



0.0000 1.0001 -0.0001 
^0.0000 0.0412 0.9588 J 

[0077] When the color value of a white point based on the sRGB color space 
(Rs, Gs, Bs) = (1 .0000, 1 .0000, 1 .0000) is converted to a color value based on the 
wRGB color space using matrix L', the value (Rw, Gw, Bw) = (1.0000, 1.0000, 
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1 .0000) is obtained. Therefore, the color value of the white point based on the 
sRGB color space converts correctly to the color value of the white point based on 
the wRGB color space, so that the gray balance of the converted color value 
represented based on the wRGB color space can be preserved. 
[0078] Image processing executed in color printer 20 is now described in detail 
with reference to Fig. 7. The control circuit 30 (CPU 31) of color printer 20 
acquires image data GD from the read out image file GF (STEP S200). As noted, 
image data is stored as a JPEG format file, and in a JPEG file, the color space of 
the created image data (sRGB color space) is converted to the YCbCr color space 
for storage of the image data, in order to increase compression. 
[0079] However, in a personal computer, printer or the like, typically only image 
data (color values) represented in the RGB color space can be handled, so it is 
necessary to the color space of color values represented in the YCbCr color space 
to the RGB color space. 

[0080] CPU 31 executes a 3 x 3 matrix operation S to convert a color value in 
the YCbCr color space to a color value in the RGB color space (STEP S210). 
Matrix operation S is defined in the JPEG File Interchange Format (JFIF) standard. 
It is a matrix equation for converting the color space of color values from the 
YCbCr color space to the RGB color space, and is a matrix equation shown below. 
When converting from the YCbCr color space to the RGB color space, color 
values that are out-of-gamut (area) in the sRGB color space, that is, any data 
assuming a negative value as a color value, or data above 256 (in the case of 8-bit 
tone) is preserved as valid. 
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[0081] CPU 31 performs gamma correction on RGB color space color values 
obtained in this way (STEP S220). When performing gamma correction, CPU 31 
refers to the DSC side gamma value in the parameters mentioned earlier, and 
uses the set gamma value (DSC fixed value) to execute the gamma correction 
indicated below on the video data (gamma conversion process). In this example, 
image data can assume negative color values, so two operation equations, one for 
when a color value is a positive value and one for when it is a negative color value, 
are prepared, so that the multiplication to be used during gamma correction can be 
executed even when a color value is negative. 
Rt 9 Gt,Bt^0 



Rs = 
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[0082] CPU 31 executes a matrix operation (N _1 M) using matrix L' = (N" 1 M) 
calculated in the manner described previously, on the color value that has been 
subjected to gamma correction (Step S230). 

[0083] CPU 31 executes inverse gamma correction on the color value converted 
to a color value based on the wRGB color space (Step S240). When executing 
inverse gamma correction, CPU 31 refers to the color printer 20 side gamma value 
in the parameters mentioned earlier, and uses the inverse of the set gamma value 
to execute the inverse gamma correction indicated below on the color value 
(inverse gamma conversion process). 
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[0084] The color space of the color value obtained after executing matrix 
operation L' is the wRGB color space. As noted, this wRGB color space is a wider 
color space than the RGB color space, and basically corresponds to the RGB 
color space reproducible by a digital still camera 12. 
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[0085] CPU 31 performs automatic image adjustment to impart features to the 
image (STEP S250). Here, the process is a process performed in accordance 
with arbitrary information in the control information. When performing automatic 
image adjustment, CPU 31 refers to parameter values such as brightness, 
sharpness etc. in the parameters mentioned earlier, and uses these set parameter 
values to execute image adjustment on the video data. Where automatic 
adjustment parameters have been designated, parameter values designated by 
automatic adjustment parameters are the basis for reflecting other arbitrarily 
designated parameter values. 

[0086] Where arbitrary information is designated by control information in the 
image file, since only automatic adjustment parameters are automatically 
appended on the digital still camera 12 side, CPU 31 executes image processing 
according to the automatic adjustment parameters. 

[0087] CPU 31 performs a wRGB conversion process and halftone process for 
printing (STEP S260). In the wRGB conversion process, CPU 31 refers to a 
lookup table (LUT) for conversion to the CMYK color space, associated with the 
wRGB color space and stored in ROM 32, and converts the color space of the 
color value (image data) from the wRGB color space to the CMYK color space. 
Specifically, image data consisting of R • G • B tone values is converted, for 
example, to tone value data for each of six colors C • M • Y • K • LC • LM. 
[0088] In halftone processing, the color-converted image data is received, and a 
tone number conversion process is performed. In this example, after color 
conversion image data is represented as data having 256 tones for each color. In 
contrast, with the color printer 20 of this example, only a state of either "dot on" or 
"dot off' can be assumed. That is, the printer 24 of this example can only 
represent two tones locally. So, image data having 256 tones is converted to 
image data represented by two tones, representable by the color printer 20. As a 
representative method for this two-toning (binarization) process, there is a method 
called the error diffusion method and a method called the systematic dithering 
method. 
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[0089] In color printer 20, before color conversion, in the event that the 
resolution of the image data is lower than the print resolution, linear interpolation is 
performed to create new data between adjacent image data, and conversely 
where higher than print resolution, data is thinned out, to perform resolution 
conversion processing to convert the resolution of the image data to the print 
resolution. Color printer 20 performs an interlacing process to line up image data 
converted a specific expression format based on the dot on-off state in the order in 
which it will be sent to the color printer 20. 

[0090] In this example, all image processing is executed in the color printer 20, 
and a dot pattern is formed on the print medium in accordance with generated 
image data, but all or some of image processing could instead be executed on a 
computer PC. In this case, it will be realized by providing an image data 
processing application installed on the hard disk etc. of computer PC with the 
image processing functions described with reference to Fig. 7. Image files created 
by a digital still camera 12 are provided to computer PC via a cable CV or via a 
memory card MC. On the computer PC, the application is run through user 
operation, and reading of the image file, analysis of extra information and control 
information, and conversion and adjustment of image data GD are executed. Or, 
by sensing insertion of a memory card MC or sensing insertion of a cable CV, the 
application can run automatically, and reading of the image file, analysis of extra 
information and control information, and conversion and adjustment of image data 
GD executed automatically. 

[0091] According to image processing in color printer 20 according to Example 1 
as described hereinabove, when converting color value color space from the 
sRGB color space to the wRGB color space, it is possible to improve accuracy of 
color space conversion, or maintain high accuracy of color space conversion. 
That is, since a matrix operation L' that uses a matrix L' derived by correcting gray 
balance error is executed, conversion of color value color space from the sRGB 
color space to the wRGB color space can be done while preserving gray balance 
with high accuracy of color space conversion. Therefore, it is possible to execute 
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conversion of color space with good accuracy, and the gray area to which the 
human visual sense is most sensitive can be represented appropriately in both the 
sRGB color space and the wRGB color space. 

[0092] Further, when converting color value color space from the sRGB color 
space to the wRGB color space, a precalculated matrix U based on matrix M and 
matrix N is used, so the speed of color space conversion can be accelerated while 
preserving gray balance. 

[0093] D. Image processing, including color space conversion processing in 
accordance with the second embodiment 

The arrangement of the image output apparatus in accordance with the 
second embodiment is the same as the arrangement of the image output 
apparatus in accordance with the first embodiment, so the symbols used in the 
first embodiment are assigned to the constituent elements, and description thereof 
is omitted. 

[0094] In the first embodiment, the description was based on the premise that 
the color value of the white point based on the first color space (sRGB color 
space) and the color value of the white point based on the second color space 
(wRGB color space) match in the XYZ color space. In contrast to this, in the 
second embodiment, there is featured the point of, where the color value of the 
white point based on the first color space and the color value of the white point 
based on the second color space do not match in the XYZ color space, correcting 
the color values of the white points based on both color spaces so as to match in 
the XYZ color space, and then executing a color space conversion process in 
accordance with the first embodiment. 

[0095] Image processing in color printer 20 in accordance with the second 
embodiment is described with reference to Fig. 9. Fig. 9 is a flow chart showing a 
processing routine for print processing in a color printer 20 in accordance with the 
second embodiment. 
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[0096] When a memory card MC is inserted in slot 34, the control circuit 30 
(CPU 31) of printer 20 reads out the image file 100 from memory card MC, and 
temporarily places the read out image file 100 in RAM 33 (STEP 100). CPU 31 
searches for the ColorSpace tag, which indicates the color space at the time of 
5 image data creation, from the extra information storage area 102 of image file 100 
(Step S1 10). If CPU 31 successfully searches/finds the ColorSpace tag (Step 
S120: Yes), it acquires and analyzes the color space information at the time of 
image data creation (Step S130). 

[0097] CPU 31 , using the analyzed color space information, determines whether 
10 the color value of the white point based on the first color space (sRGB color 
space) and the color value of the white point based on the second color space 
(wRGB color space) match in the XYZ color space (Step S1301). In the event that 
CPU 31 has determined that the color values of the white points based on both 
color spaces match in the XYZ color space (Step S1 301 : Yes), on the basis of the 

® 15 analyzed color space information executes a process to correct the matrix L used 

%J 

* in the color space conversion process and calculate a matrix L\ described later 

Q 

5 (Step S140). 

J [0098] If on the other hand CPU 31 has determined that the color values of the 
white points based on both color spaces do not match in the XYZ color space 
20 (Step S1301 : No), it executes a correction process to match the color values of the 
white points based on both color spaces in the XYZ color space (Step S1302). 
This correction process is discussed later. CPU 31 , after executing the correction 
process to match the white points, on the basis of the analyzed color space 
information executes a process to correct the matrix L used in the color space 
25 conversion process and calculate a matrix L\ described later (Step S140). The 
determination as to whether the white points based on both color spaces match in 
the XYZ color space, as explained in Example 1 , is determined by whether the 
relationships a1 + b1 + d = a2 + b2 + c2, d1 + e1 + f1 = d2 + e2 + f2, and g1 + hi 
+ i1 = g2 + h2 + i2 are true. 
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[0099] CPU 31 executes an image process including a color space conversion 
process using the matrix U calculated by means of correction (Step S150) and 
prints out the processed image data (Step S160). If CPU 31 has not 
searched/found a ColorSpace tag (Step S120: No), it acquires from ROM 32 color 
space information held as default values by color printer 20, for example, 
information for the sRGB color space, and executes ordinary image processing 
(STEP S170). CPU 31 prints out the processed image data (Step S160) and 
terminates the processing routine. 

[0100] The correction process for matching white point is described. Where the 
tristimulus values in the sRGB color space are (Xs, Ys, Zs) and the tristimulus 
values of the corresponding color giving the same perception in the wRGB color 
space are (Xw, Yw, Zw), according to Vonkries rule the following relationship is 
true. Vonkries rule is a color conversion method that considers that when the 
illuminant light source (white point) differs, the human eye has the function of 
maintaining a fixed color perception for colors of different illumination (chromatic 
adaptation), and is a law that holds that where stimuli in the three types of cells in 
the spindles of the human eye are L, M, N, the stimulus amount sensitivity is 
inversely proportional to the illuminant light source. 

Lwwl Lws 
0 
0 

[0101] Conversion from tristimulus values XYZ to cone level stimulus amounts L, 
M, N uses the following conversion matrix Mb, proposed by Bladford. 
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[0102] (Lws, Mws, Nws) and (Lww, Mww, Nww) are stimulus amounts of 
illumination (white) in the sRGB color space and wRGB color space, respectively; 
the case of converting color values in the sRGB color space to color values in the 
XYZ space by matrix M, described previously, and converting color values in the 
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wRGB color space to color values in the XYZ space by matrix N, described 
previously is represented as follows. 
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[0103] Using relational equations according to the VonKries rule, the white point 
of the wRGB color space of the output color value side is corrected so as to match 
the white point of the sRGB color space of the input color value side. 
[0104] As described hereinabove, according to the second embodiment, even if, 
for example, the white points of two color spaces, namely the sRGB color space 
and the wRGB color space, are different in the device-independent color space, by 
means of correction the white points of the two color spaces can be matched in 
the device-independent color space. Accordingly, the color space conversion 
process described in the first embodiment can be implemented, and the effects 
obtained in the first embodiment can be obtained. 

[0105] In the second embodiment, the output color value side white point 
converted from the RGB color space to the XYZ color space is corrected to match 
the white point of the enter six side white point converted from the RGB color 
space to the XYZ color space, but correction may be performed during conversion 
of color value color space from the RGB color space to the XYZ color space. That 
is, the coefficients of matrix M or matrix N may be corrected to match the white 
point of the input color value side in the XYZ color space to the white point of the 
output color value side in the XYZ color space, or to match the white point of the 
output color value side in the XYZ color space to the white point of the input color 
value side in the XYZ color space. This is because in either case, there is no 
change in the ability to match the white points of the two color spaces in the XYZ 
color space. 
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[0106] E. Other embodiments 

In the preceding embodiments, a matrix L' for converting color space is 
calculated dynamically and color space conversion processing is performed, but 
color space conversion processing could be executed using a precalculated matrix 
L\ or using a color conversion table storing color conversion results by matrix L' for 
a plurality of color values. Where a predetermined matrix L' is used, a plurality of 
matrices L' for each combination of first color space and second color space are 
calculated, and depending on the image file GF to be processed a suitable matrix 
L' is selected from the plurality of matrices L\ Where a color conversion table is 
used, for an arbitrary matrix L\ each matrix U is used to convert a plurality of 
arbitrary color values based on a first color space to a plurality of color values 
based on a second color space, and a color conversion table that associates color 
values based on the second color space obtained by the conversion with a 
plurality of arbitrary color values based on the first color space is created. During 
the color space conversion process, depending on the combination of first color 
space and second color space, one color conversion table from among a plurality 
of color conversion tables is selected, and color conversion processing is executed 
using the selected color conversion table. 

[0107] With either method, whether to convert the color space defining image 
data GD from a first color space to a second color space is an arbitrarily selected 
item, but where matrix U is generated dynamically, any color space can be dealt 
with, and color conversion with good accuracy can be realized. Where a 
predetermined matrix L' is used, fewer memory resources are needed to store 
matrix L", and high speed color conversion processing can be realized. Where a 
color conversion table is used, faster color conversion processing can be realized. 
[0108] In the preceding embodiments, matrix M is determined using color space 
information described by the ColorSpace tag, but where associated with image 
data GD control information, matrix M may be determined using color space 
information to be used during image processing, stored in control information. In 
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this case, for example, matrix values for matrix M may be stored as color space 
information, and matrix M set by reading out the stored matrix values. 
[0109] While in the preceding embodiments of image processing, color printer 
20 is used as the output apparatus, a display apparatus such as a CRT, LCD, 
projector etc. could also be used as the output apparatus. In this case, depending 
on the display apparatus used as the output apparatus, an image processing 
program (display driver) for executing the image processing described in Fig. 7 
etc., for example, could be used. Or where a CRT etc. functions as a display 
apparatus for a computer, the image processing program can be run on the 
computer side. In this case the final output image data will have the RGB color 
space, not the CMYK color space. 

[0110] In this case, in a manner analogous to print results via color printer 20 
being able to reflect the color space of color values generated by a digital still 
camera 12, it is possible to designate, by means of the image file, display results 
in a display apparatus such as a CRT. Accordingly, by including parameters 
suited to a display apparatus such as a CRT in the control information of an image 
file, image data GD created by a digital still camera 12 can be correctly displayed. 
[011 1] Although the color space converting apparatus pertaining to the present 
invention has been described on the basis of some examples, the aforementioned 
aspects of the present invention are merely to facilitate understanding of the 
present invention, and do not limit the present invention. The present invention 
can be modified and improved without departing from the spirit and scope thereof 
as recited in the claims, and these equivalents are of course included in the 
present invention. 

[01 12] The parameter values given in the preceding embodiments are merely 
exemplary and the invention pertaining to this application is not limited by these 
parameters. Further, the values of matrices S, M, L and L" in the equations are 
merely exemplary, and may be modified as appropriate with reference to target 
color space, the color space that can be utilized by color printer 20, and the like. 
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[0113] In the preceding embodiments, color space information read out from the 
image file is used to improve color space accuracy and perform matching of white 
point, but image data could be analyzed directly to acquire color space information, 
or color space information could be entered separately. 

[0114] In the preceding embodiments the use of a digital still camera 12 as the 
image file generating apparatus is described, but scanners, digital video cameras 
or the like may be used as well. Where a scanner is used, specification of image 
file output control information may performed on a computer PC, or performed with 
the scanner independently by providing the scanner with preset buttons having 
assigned thereto preset information for setting information, or with a display screen 
and setting buttons for making arbitrary settings. 

[0115] The color spaces used in the preceding embodiments are merely 
exemplary, and other color spaces may be used. In any case, it is sufficient for 
image data created by an image data generating apparatus such as a digital still 
camera 12 etc. to be output reflecting the color space of the image data generating 
apparatus. 

[0116] The preceding embodiments describe an Exif format file as the image file, 
but the image file format pertaining to the present invention is not limited thereto. 
Any image file that includes at least image data for output by an output apparatus 
and information relating to color space used in an image data generating 
apparatus such as a digital still camera 12 etc. is sufficient. This is because with 
such a file, difference in output image between image data generated in an image 
data generating apparatus (image display obtained through a monitor etc.) and 
output image in an output apparatus can be minimized. 
[0117] The color printer 20 pertaining to the preceding examples is merely 
exemplary, and the arrangement thereof is not limited to that described in the 
examples. It is sufficient for color printer 20 to be able to analyze extra information 
and control information in an image file, and output (print) an image in response to 
described or designated color space information. 
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[0118] In the preceding embodiments, there is described by way of example the 
case of image data GD and control information being included in the same image 
file GF, but it is not necessary for image data GD and control information to be 
stored in the same file. That is, image data GD and control information may be 
associated, for example, generating associated data consisting of associated 
image data GD and control information, storing one or a plurality of image data 
and control information in independent files, and referring to the associated control 
information when processing the image data GD. While in this case image data 
and control information are stored in separate files, during image processing using 
the control information, the image data and control information are indivisibly 
united, so functionality is substantially the same as with storage in a single file. 
That is, the aspect of using associated image data and control information, at least 
during image processing, is included in the image file GF in the present examples. 
Motion video files stored on optical media such as CD-ROM, CD-R, DVD-ROM, 
DVD-RAM and other optical disk media are also included. 
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